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(57) Abstract 

Hypervideo data is encoded with two distinct portions, a first portion which contains the video data and a second portion, typically 
much smaller than the first, which contains hyperlink information associated with the video data. Preferably, the first and second portions 
are stored in separate and distinct files. The encoding of the hyperlink information is preferably made efficient by encoding only key frames 
of the video, and by encoding hot link regions of simple geometries. A hypervideo player determines the hot link regions in frames between 
key frames by interpolating the hot link regions in key frames which sandwich those frames. 
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^ Method and Apparatus for Integrating Hyperlinks in Video 
Background of the Invention 

L Field of the Invention 

The present invention is related to systems for creating and editing video and, more specifically, to 
5 systems that integrate hyperlink information with video. 

2x Related Art 

Hypermedia is a term used to describe the fusion of two other new technologies: multimedia and 
hypertext. Multimedia refers to information forms containing text, images, graphics, audio and 
video. A hypertext document is one which is linked to other documents via hyperlinks. A hyper- 

10 link often appears in a hypertext document as a piece of highlighted text. The text is usually a 
word or phase describing something of which a user might want further information. When the 
user activates the hyperlink, typically by clicking on it using a mouse, a link command is initiated; 
which causes a program at the linked address to be executed; which, in turn, causes the user's 
view to be updated so as to show the linked document, which typically contains more information 

15 on the highlighted word or phase concerned. Such information may be in the form of text, audio, 
video, a two-dimensional image or a three-dimensional image. Hyperlinks make it easy to follow 
cross-references between documents. Hypermedia documents are hypertext documents with 
multimedia capabilities. The regions on the screen which are active hyperlinks are called hot-links. 

20 Nowadays, most people are familiar with the application of hypertext by using a mouse to click on 
hot-links on computer displays of homepages from the World Wide Web (the Web) on the Inter- 
net. Data on the Web is located via URLs. URL stands for "Uniform Resource Locator." It is a 
draft standard for specifying an object on the Internet. It specifies access method and the location 
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for the files. Documents on the Web are written in a simple "markup language" called HTML, 
which stands for Hypertext Markup Language. File formats of data on the Web are specified as 
MIME formats; MIME stands for "Multipurpose Internet Mail Extensions." (Reference: 
http://www.oac.uci.edu/ indiv/ehood/MIME/MIME.html). Examples of file formats on the Web 
5 are .au (probably the most common audio format), .html (HTML files), .jpg (JPEG encoded im- 
ages), .mid (Midi music format), mpg (MPEG encoded video), and .ps (postcript files). While 
presently hypertext technology is most common in text and image media, it is beginning to also 
appear in animation and video. 



HyperVideo is the name for video augmented with hyperlinks. NEC Corporation has demon- 
10 strated to Newsbytes such a system, named "video hypermedia system," that will bring the point 
and click capabilities of hypertext to full motion video. A more detailed description of Hyper- 
Video may be found in the article "NEC's Video Hypertext System". Newsbytes News Network, 
July 3 1,1995. 

HyperCafe is an experimental hypermedia prototype, developed as an illustration of a general hy- 
15 pervideo system. This program places the user in a virtual cafe, composed primarily of digital 
video clips of actors involved in fictional conversations in the cafe. HyperCafe allows the user to 
follow different conversations, and offers dynamic opportunities of interaction via temporal, 
spatio-temporal and textual links to present alternative narratives. A more detailed description of 
HyperCafe may be found in the article by Nitin "Nick" Sawhney. David Balcom and Ian Smith. 
20 "HyperCafe: Narrative and Aesthetic Properties of Hypervideo," Hypertext '96: Seventh ACM 
Conference on Hypertext (Recipient of the first Engelbart Best Paper Award at Hypertext '96 
(March 20, 1996), http://silver.skiles.gatech.edu/gallery/hypercafe/HT96_Talk/. 

VideoActive is an authoring tool for the creation of interactive movies. It uses the HyperVideo 
25 technology to identify hot-links in digital video files. The tool allows one to prepare video clips 
with the hot-link information and then to link them to other types of media. A more detailed de- 
scription of VideoActive may be found in "HyperVideo Authoring Tool (User Notes)". 
http://ephyx.com/. Pre-Release version. Feb. 1996. 
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Progressive Networks, Inc. has included "click-able video maps" in their RealVideo technology. A 
mouse click on a portion of the video can cause a new video clip to be played, seek within the cur- 
rent clip, or send a URL message. They provide the RealPlayer which enables this interactivity. A 
more detailed description of RealVideo may be found at Progressive Network, Inc.,"RealVideo 
5 Technical White Paper", http://www.realaudio.com/products/realvideo/overview/index.html. 

A feature shared by all these technologies is that the size of the hypervideo is huge. Basically, the 
hypervideo information contains both the encoded video and the hyperlink information. In order 
to augment hyperlink information to a video clip, one has to create a file that is larger than the 
10 original video file. In order to transmit hyperlink information one has to transmit a huge file, even 
if the receiver may have locally a copy of the original video file. Frequently a user may have a 
video file on a CD-ROM, and would like to augment hyperlink information to this video. With the 
existing technologies, the user would have to either generate a file or download an already gener- 
ated file at least as large as the original. 

15 With existing technology, the creation of hypervideo content is tedious because the hot informa- 
tion is encoded in each frame in which the hypervideo link exists. 

Summary of the Invention 

The present invention addresses this issue by creating a small file which contains a pointer to the 
20 corresponding video file and which encodes the hyperlink information in an efficient manner. Hy- 
pervideo data is encoded with two distinct portions, a first portion which contains the video data 
and a second portion, typically much smaller than the first, which contains information regarding 
the identification of the first portion and the hyperlink information. The encoding of the hyperlink 
information is made efficient by encoding only key frames in the video, and by encoding hot link 
25 regions of simple geometries. A hypervideo player determines the hot link regions in frames be- 
tween key frames by interpolating the hot link regions in key frames which sandwich those frames. 

In a preferred embodiment, the hot link regions are rectangular with axes parallel to the major 
axes, and encoded by listing their top-left and bottom-right vertices. The interpolation of hot link 
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regions between key frames is linear. This schemes works well because in general motion of ob- 
jects in time intervals in video can be well approximated by motions in contiguous time subinter- 
vals, each of which is approximately linear. This scheme both greatly reduces the amount of data 
required to encode the hot region information and speeds up significantly the process of creating 
5 hypervideo content. 

Brief Description of the Drawings 

FIG. 1 is a functional block diagram of a computer processing system that may be utilized by the 
preferred embodiment of the present invention. 

10 FIGS. 2(A) and (B) illustrates format of an MPEG encoded video file; 

FIGS. 3(A)-(C) illustrate formate of a hyperlink file according to the present invention; and 

FIG. 4 is a functional block diagram illustrating a video player for integrating a video file with the 
hyperlink information stored in the hyperlink file of FIGS. 3(A)-(C). 

FIGS. 5(A) and (B) is a functional block diagram illustrating a tool for creating the hyperlink in- 
15 formation stored in the hyperlink file of FIGS. 3(A)-(C). 

FIGS. 6 and 7 are pictorial illustrations of an example of graphical user interface for the tool of 
FIGS. 5(A) and (B). 

Detailed Description of the Invention 

The present invention may be implemented on any computer processing system including, for ex- 
20 ample, a personal computer or a workstation. As shown in FIG. 1, a computer processing system 
as may be utilized by the present invention generally comprises memory 101, at least one central 
processing unit (CPU) 103 (one shown), and at least one user input device 107 (such as a key- 
board, mouse, joystick, voice recognition system, or handwriting recognition system). In addition, 
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the computer processing system includes a nonvolatile memory, such as (ROM), and/or other 
nonvolatile storage devices 108, such as a fixed disk drive, that stores an operating system and 
one or more application programs that are loaded into the memory 101 and executed by the CPU 
103. In the execution of the operating system and application program(s), the CPU may use data 
5 stored in the nonvolatile storage device 108 and/or memory 101. In addition, the computer proc- 
essing system includes a graphics adapter 104 coupled between the CPU 103 and a display device 
105 such as a CRT display or LCD display. The application program and/or operating system 
executed by the CPU 103 generates graphics commands, for example, a command to draw a box 
(or window), a command to display a bit map image, a command to render a three-dimensional 
1 0 model, or a command to display a video file. Such commands may be handled by the application 
program/operating system executed by the CPU 103, or by hardware that works in conjunction 
with the application program/operating system executed by the CPU 103, wherein the appropriate 
pixel data is generated and the display device 105 is updates accordingly. 

In addition, the computer processing system may include a communication link 109 (such as a net- 
15 work adapter, RF link, or modem) coupled to the CPU 103 that allows the CPU 103 to communi- 
cate with other computer processing systems over the communication link, for example over the 
Internet. The CPU 103 may receive portions of the operating system, portions of the application 
program(s), or portions of the data used by the CPU 103 in executing the operating system and 
application program(s) over the communication link 109. 

20 It should be noted that the application program(s)/operating system executed by the CPU 103 may 
perform the methods of the present invention described below. Alternatively, portions or all of 
the methods described below may be embodied in hardware that works in conjunction with the ap- 
plication program/operating system executed by the CPU 103. In addition, the methods described 
below may be embodied in a distributed processing system whereby portions of such methods are 

25 distributed among two or more processing systems that are linked together via communication 
link 109. 



According to the present invention, a second-file (referred to below as a HotVideo data file), that 
corresponds to a given video file and preferably is separate and distinct from the corresponding 



WO 98/44435 



PCT/IB97/00331 



-6- 

video file, is provided that identifies hot-links in the corresponding video file. A hot-link (or hot- 
link region) is an area of pixels in one or more frames of a video file that represents a hyperlink to 
related information. When the user activates the hyperlink, typically by clicking on it using a 
mouse, a link command is initiated. The link command identifies a processing system and one or 
5 more operations to be performed by such processing system when the link command is initiated. 
The processing system identified by the link command may be the same system that is processing 
the video file, or may be a remote system that is coupled via a communication link to the system 
that is processing the video file. The initiation of the link command causes the operation identified 
by the link command to be executed by the processing system identified by the link command. 

10 Typically, execution of the link command causes the user's view to be updated so as to show 
linked content. The linked content typically contains information related to images displayed in or 
near the hot-link. Such information may be in the form of text, audio, video, a two-dimensional 
image or a three-dimensional image. An example of a link command may be a hypertext link in 
HTML format which causes a remote computer to download an HTML page to the user's proc- 

15essing system. 

Hot Video Encoding Format 

The encoding of hot- link regions in a particular video preferably utilizes the following schemes. 
First, the hot-link regions have simple geometries. In a preferred embodiment, the hot-link regions 
are rectangles whose edges lie along the major axes of the display, and specified by top-left and 

20 bottom-right pixel coordinates in a given frame of video. Second, the hot-link regions are not en- 
coded in each frame. Rather, a user records hot-link regions in what are called key frames. Pref- 
erably, key frames are chosen so that the trajectory of objects associated with a given hot-link area 
in the time interval between such frames is approximately linear (that is, it has no acceleration). In 
this case, the hot-link region can be specified by its position is such key frames and the play-back 

25 device can perform linear interpolation to determine the position of the hot-link region in interme- 
diate frames that lie between such key frames. A more detailed description of such key frames is 
set forth below. 
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Video files are encoded in various standard video formats, such as AVI, MPEG, raw YUV, and 
raw RGB. For example, Le Gall, Didier J., "MPEG video compression algorithm," Signal Proc- 
ess Image Commun v 4 n 2 Apr 1992 p 129-140, describes the MPEG video format. These video 
formats comprise header information describing some features of the video such as frame rate and 
5 file size; encoded pixel values of the color components of the various frames in the video; encoded 
audio data which synchronously accompanies the video. A frame of video is a single image; video 
comprises contiguous frames, such that when these are played at a sufficiently high frame rate 
(typically 25 or 30 frames per second) the result is a visually pleasant motion video. Frames in 
video are frequently numbered consecutively - frame 1 being the first frame, frame 2 the second, 
1 0 etc. The term frame number refers to the number of a frame in this consecutive ordering. As an 
example, FIGS. 2(A) and (B) illustrate the format of an MPEG encoded video file. The 
HEADER contains information such as system clock reference and bit rates for video and audio 

components. The data packets DATAfj). j = 1. 2 N contain the actual encoded video and 

audio data. The DATA(j) are described in FIG. 2(B). A special START code signals the start of a 
15 new data packet; AV(j) identifies the forthcoming data as either audio or video; TIME(j) gives the 
timing information necessary to synchronize the video with the audio; ENCODED_DATA(j) are 
the actual audio or video data. The encoded video data contains information regarding pixel val- 
ues of color components of frames in the video. In MPEG video, for example, the ENCOD- 
ED_DATA(j) are binary streams of Huffman encoded run-lengths of quantized DCT coefficients. 
20 For a more detailed example see the MPEG standards document, Draft International Standard 
ISO/DIS 1 1 172 (ISO/IEC JTC I), herein incorporated by reference in its entirety. 

FIGS. 3(A)-(C) illustrate the structure of the second file that contains the hyperlink information 
(i.e., the encoded HotVideo data). In FIG. 3(A), HD is header information which identifies a 

25 correspondence between the second file and the associated video file. In the preferred embodi- 
ment, the name of the second file is the same as the prefix of the name of the associated video file 
(for example, if the video file is an MPEG file called "title.mpg", the name in the header is "title"). 
The header information HD may also identify properties of the associated video file, for example, 
the size of the file (in bytes) and the frame-rate of the associated video file. Such information 

30 amy be used to verify that the associated video file matches the HotVideo data file, as file names 
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may have changed. While this is not a fool-proof verification method, it will catch most 
mismatches. 

OB(l) OB(N) are N hot objects. Each hot object OB(j) defines a hot-link area in one or 

more frames in the associated video file. A description of their encoding is provided in FIG. 3(B). 
5 Each object OB(j) is preferably encoded with an identifier ON(j), an object name, an associated 
link address OA(j), a list L(j,k) of identifiers of its hot-link regions in the video, and a trailer T(j) 
demarcating the end of the encoding for the j-th object. The symbol Kj denotes the total number of 
identifiers of the j-th object. 

As shown in FIG. 3(C), an identifier L(j,k) specifies the spatial position of the hot-link region in a 
1 0 particular key frame. It preferably comprises four pieces of information: a bit B(j,k) specifying 
whether the key frame is an end frame or not; the number NQJk) of the k-th key frame of the j-th 
object; the coordinates (x(j,k,l), y(j,k,l)) of the top-left vertex of the rectangular hot region in the 
k-th key frame of the j-th object; the coordinates (x(j,k,2), y(j,k,2)) of the bottom-right vertex of 
the rectangular hot region in the k-th key frame of the j-th object. The numbers N(j,k) correspond 
1 5 to the frame numbers, which are key frames or end frames. 

The following table gives a description of the fields of the hyperlink file in FIGS. 3(A)-(C): 

HD identifies the corresponding video file; 

OB(j) for the j-th hot link object, identifies a link command to execute upon the 
20 user selecting the hot link; 

ON(j) for the j-th hot link object, associates its name; 

OA(j) for the j-th hot link object, identifies its link address; 

L(j,k) for the j-th hot link object, identifies the k-th key frame used in encoding that 
object; 

RECTIFIED SHEET (RULE 91) 
ISA/EP 
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B(j,k) for the j-th hot link object, identifies whether or not the. k-th key frame is an 
end frame; 

N(j,k) for the j-th hot link object, identifies the frame number of the k-th key frame; 

x(j,k,l) the top-left x-coordinate of the rectangular region defining the hot link re- 
5 gion in the k-th frame of the j-th object; 

y(j,k, 1) the top-left y-coordinate of the rectangular region defining the hot link re- 
gion in the k-th frame of the j-th object; 

x(j,k,2) the bottom-right x-coordinate of the rectangular region defining the hot 
link region in the k-th frame of the j-th object; and 

10 y(j.k t 2) the bottom-right y-coordinate of the rectangular region defining the hot 

link region in the k-th frame of the j-th object. 

As described above, the hot-link region preferably has a rectangular geometry. However, the pre- 
sent invention is not limited in this respect; thus, the hot-link region may have any geometry. For 
example, the hot-link region may have a circlular geometry, and be defined by position of the cen- 
15 ter of the circle and the radius of the circle. 

HotVideo Plaver 

FIG. 4 illustrates a HotVideo Player that reads a video file and integrates the hotlink information 
contained in the associated second file with the video contained in the video file; this is the data 
20 described in FIGS. 2 and 3(A)-(C). The HotVideo Player may be part of an application program 
and/or operating system executed by the CPU 103 of FIG. 1. Alternatively, portions or all of the 
HotVideo Player may be embodied in hardware that works in conjunction with the application 
program/operating system executed by the CPU 103. In addition, portions of the HotVideo 

RECTIFIED SHEET (RULE 91) 
ISA/EP 
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Player be embodied in a distributed processing system whereby portions of the functionality the 
HotVideo Player are distributed among two or more processing systems that are linked together 
via a communication link 109. 



Referring now to FIG. 4, from the header data HD, HVP determines which video file to associ- 
5 ate with the HotVideo file (second file). It sends a message to the VIDEO_PLAYER to open that 
video file. If the properties of the video file match those described in the header, the 
VIDEO.PLAYER starts playing the video file. Otherwise the VIDEO.PLAYER prods the user 
to find the appropriate video file. HVP also parses the data and arranges it in a format which 
makes searching through it simple. 

10 The VIDEO.PLAYER begins playing the video. At each frame, the VIDEO.PLAYER passes to 
the FRAME_CHECK stage a value indicating which frame number it is presently displaying. It 
may happen that frames are dropped, so that frame numbers need not be consecutive. After de- 
coding the present frame, the VIDEO.PLAYER outputs the frame image data to the BUFFER. 
The more specific operation of the VIDEO.PLAYER in decoding frames of the video file is not 

15 relevant to the present invention; thus, the present invention may be used with any 

VIDEO_PLAYER that decodes frames of a video file and outputs the frame image data to persis- 
tent memory. An example of such a VDDEO^PLAYER is the Active Movie Video Player pro- 
vided by Microsoft Corporation in the Active Movie Software Development Kit, described in 
detail at http://www.microsoft.com/imdeia/activemovie/activem.htm, herein incorporated by refer- 

20 ence in its entirety. 

The FRAME.CHECK stage determines, for each object OB(j) in the second file, whether or not 
the following two conditions are satisfied: 

i) the present frame number is a key frame for that object or the present frame 
number lies between two key frames for that object; and 



25 



ii) the first key frame is not an end frame for that object. 
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If the two conditions are satisfied, then INTERPOLATE / OVERLAY / DISPLAY operations are 
performed. 

The INTERPOLATE operation uses the coordinate data from the two key frames that sandwich 
the present frame and their respective frame numbers, to linearly interpolate a rectangular region 
5 for the present frame which will be its hot region. A more detailed description of the INTERPO- 
LATE operation is described below. 

OVERLAY then takes this information and modifies the data in BUFFER to identify the hot-link 
region. Preferably, OVERLAY modifies the data in BUFFER to identify the hot-link region by 
changing those pixel values corresponding to the boundaries of the hot link region to a fixed 
10 color. Alternatively, the OVERLAY function may changes the brightness and/or hue of the re- 
gion, or use another technique to identify the hot-link region. 

DISPLAY then takes the resulting data from BUFFER and displays them on a computer monitor. 

If in the FRAME_CHECK stage the two conditions are not satisfied, then nothing is done further 
15 for that object in the present frame, and the frame is displayed as part of the video sequence. 

A detailed description of the INTERPOLATE operation is now set forth. Assume that the 
VIDEO.PLAYER is displaying frame number F that lies between two key frames N(j,k) and N(j, 
k+1). As described above N(j,k) is the frame number for the k-th key frame for the object OB(j) 
and N(j,k+1) is frame number for the (k+l)-th key frame for the object OB(j). Also assume that 
20 the frame N(j,k) is not an end frame for the object OB(j). In this case, some rectangular region 
in frame number F is a hot-link region, and the hot link corresponding to this region will point to 
the address OA(j). The hot region in frame F will be determined as follows: 

let x(F,l), y(F,l), x(F,2), y(F,2) denote, correspondingly, the top-left x-coordinate 
of the rectangular hot region for OB(j) in frame number F, the top-left y-coordinate 
25 for that hot region, the bottom-right x-coordinate for that hot region, and the 

bottom-right y-coordinate for that hot region as stored in the second file, 
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then x(F,l) = (l-z)*x(j.k,l) + z*xG,k+l,l), 

y(F,l) = (l-z)*yajc,l) + z*y(j.k+l,l). 

x(F,2) = (l-z)*x(j.k,2) + z*xG,k+l,2), 

y(F,2) = (l-z)*y(j.k,2) + z*y(j,k+l,2), 

5 where z = (F - N(j,k)) / (NG,k+ 1 ) - N0,k)), 

where * denotes multiplication and the equality in the above four equations is pref- 
erably determined after rounding to nearest integer. 

INTERPOLATE performs the computation suggested by the above equations to form the coordi- 
10 nates of the rectangle that dictates the boundary of the hot-link region. 



The table below illustrates an example of an encoding of a rectangular hot region in the Hot Video 
file: 



j ObjectName 


http://www.object_address.htmI | 


0 


65 


(20,30) 


(40,70) 


0 


95 


(20,30) 


(40,70) 


0 


120 


(70,130) 


(90.170) 


1 


220 


(120,130) 


(140,170) 


0 . ~ 


300 


(120,130) 


(140,170) 


I 


400 


(120,130) 


(140,230) 



An object called ObjectName is linked to the URL http://www.object_addres.html. It is encoded 
in six key frames: 65, 95, 120, 220, 300 and 400. Frames 220 and 400 are end-frames (as indi- 
15 cated by the binary digit 1; those labeled 0 are key frames which are not end-frames). In the video. 
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a hot-region rectangle is created in frame 65 with top-left vertex at (20,30) and bottom right 
tex at (40,70). Thus the size of the rectangle is 20 by 40 pixels (20 in height and 40 in width). 

The hot rectangular region contains within its boundaries portions of the object. For example, if 
the object is a person, the rectangular region may contain within it the entire person, or the per- 
5 son's head. The choice of rectangle delineating the object is not up to the Hot Video author; a 
guiding principle is that a HotVideo viewer should easily identify the object from its position rela- 
tive to the associated rectangle. The hot region is then encoded in the second key frame, number 
95. The rectangle is identical to the one if the first key frame. 

The HotVideo Player preferably interprets this data such that for all frames between 65 and 95 

10 (including frames 65 and 95), the rectangle with coordinates as specified will be identified as a 
hot-link region. The hot-link region is encoded again in the third key frame, number 120, but now 
at a different position. Its top-left vertex is at (70,130) and its bottom right vertex is at (90,170). 
The rectangle has not changed size, but it has shifted down 50 pixels and to the right 100 pixels. 
The HotVideo Player preferably interprets this data such that for all frames between 95 and 120, a 

15 rectangle of approximate size 20 pixels by 40 pixels and at position somewhere between its posi- 
tion in frame 95 and its position in frame 120 will be identified as a hot-link region. Its exact size 
and position will depend oruhe type of interpolation used. The hot region is encoded again in the 
fourth key frame, number 220, with a top-left vertex at coordinates (120,130) and a bottom-right 
vertex at coordinates (140, 170). Again the rectangle has not changed size; this time it has shifted 

20 50 pixels down, and has not shifted horizontally at all. The HotVideo Player preferably interpo- 
lates such data to create hot regions between these key frames. The hot region is encoded again 
in the fifth key frame, number 300, again with a top-left vertex at coordinates (120,130) and a 
bottom-right vertex at coordinates (140,170). Because the fourth key frame (number 220) is an 
end-frame, the HotVideo Player will not produce hot regions for this object for the frames 221 to 

25 299. Finally, the hot region is encoded again in the sixth key frame, number 400, with a top-left 
vertex at coordinates (120, 130) and a bottom-right vertex at coordinates (140,230). This time the 
size of the rectangle has changed. In this case, the HotVideo Player preferably interpolates such 
data to yield hot rectangles of increasing sizes between frames 300 and 400. The sixth key frame is 
also an end-frame. 
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Hot Video Authoring Tool 

FIGS. 5(A) and (B) illustrate a functional block diagram of an embodiment of a software applica- 
tion that provides an author with the ability to create the Hot Video file as describe above. 
OPEN_HVF initiates the software application and either opens an already existing HotVideo file 
5 or labels a new HotVideo file. OPENJVIDEO controls a HOTVIDEO PREVIEWER to open the 
video file associated with the HotVideo file. The HOTVIDEO PREVIEWER decodes frames of 
the video, integrates the information contained in the HotVideo data file with the frame image 
data contained in the video file, and outputs resultant frame image data for display. The function- 
ality of the HOTVIDEO PREVIEWER is similar to the HOTVIDEO PLAYER as set forth above. 
10 However, unlike the HOTVIDEO PLAYER that uses interpolation to position the hot-link re- 
gions in frames between key frames, the HOTVIDEO PREVIEWER positions a hot-link region at 
its last-defined position until the next key frame or end frame is marked. 

In addition, the application includes a NAVIGATE function that provides the user with the ability 
to navigate through the frames of the video file. For example, the NAVIGATE function prefera- 

15 bly includes a PLAY, STOP, SEEK, STEP FORWARD, AND STEP BACKWARD function. 
The PLAY function controls the HOTVIDEO PREVIEWER to play the video file (i.e., step 
through the frames of the video file and output the frame image data for display). The STOP 
function controls the HOTVIDEO PREVIEWER to stop playing the video file (i.e., terminate 
stepping through the frames of the video file and output for display the frame image data for the 

20 frame corresponding to the stop request). The SEEK function controls the HOTVIDEO PRE- 
VIEWER to decode and output for display a particular video frame, which may be identified by 
the position of a slider on a slider bar as described below. This provides the author with course- 
grained control of the HOTVIDEO PREVIEWER. The STEP FORWARD and STEP BACK- 
WARD function controls the HOTVIDEO PREVIEWER to decode and output for display the 

25 next subsequent frame. This provides the author with fine-grained control of the HOTVIDEO 
PREVIEWER. 

An ENCODE function identifies when the author has decided to encode a hot-link region in the 
frame which is presently output for display by the video player. When the ENCODE function 
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identifies that the author has decided to encode a hot-link region in the current frame, a DE- 
FINE_HOT_LINK_REGION function is invoked, which is an interactive procedure which en- 
ables the author to identify a region in the current frame which is to become a hot-link region. For 
example, the hot-link region may be defined by the frame number and pixel coordinates of the top- 
5 left and bottom-right vertices of a rectangle as described above. In this case, the current frame 
number is provided by the HOTVIDEO PREVIEWER. The coordinates of the vertices of the 
rectangle may be created via a Windows ciick-and-drag process; the left button of the mouse is 
clicked when the cursor is on the top-left vertex; the user then drags the mouse with the left but- 
ton still depressed until the cursor lies on the bottom-right vertex, at which point the user releases 
10 the depressed button. 

After defining the hot-link region, preferably an ATTACH.OBJECT function is invoked that pro- 
vides the author with the ability to attach the hot-link region to an object. The object may be an 
existing object (i.e., an object corresponding to previous hot-link regions of the video file), or a 
new object (i.e., an object that does not correspond to previous hot link regions of the video file). 
15 This is done by either typing in a name for the object, or in the case where the object 

has already been defined, by clicking on that object name listed in another window in the tool 
which lists all the already defined objects. 

After attaching the object to a hot-link region, an ATTACH_LINK_COMMAND function is in- 
voked that attaches a link command to the object. If the object is new, then the user identifies a 

20 link command associated with the object If the object is not new, then the object may already 
have an associated link command. In this case, the ATTACH_LINK_COMMAND function may 
be bypassed. As described above, the link command identifies a processing system and an opera- 
tion to be performed by such processing system when the link command is initiated. For example, 
the link command may be a URL address which is to be linked when the hot-link region is selected 

25 by a user. 



The application also provides an MARK_END_FRAME function that provides the author with 
the ability to identify a frame encoded with HotVideo data as an end frame. Preferably, the 
author decides whether this key frame which had just been encoded is an end-frame or not. If it is 



WO 98/44435 



PCT/IB97/00331 



-16- 

an end-frame, the user then invokes a MARK_END_FRAME function to mark the frame as an 
end-frame. Preferably, the user then has the option to save the present state of the Hot Video data 
file and the option of exiting the application. If the user decides to continue and not exit, the user 
can continue to repeat the process, thereby navigating through the video file and encoding hot-link 
5 regions within frames of the video file. 

In addition, the application preferably includes options that allow the author to undo a step al- 
ready made, erase geometry defining a key-frame hot-link region, remove an object (which re- 
moves all information regarding the encoding of this object), plus the standard editing tools which 
are provided by the operating system. 

10 FIG. 6 illustrates an example of a graphical user interface to the software application of FIGS. 
5(A) and (B). In this embodiment, the link command associated with a given object is a URL; 
however, the present invention is not limited in this respect and can be any operation(s) performed 
by the processing system identified by the link command. There is the video window (VW) 501 
on the left, in which the video and hot-link regions will be displayed and acted upon via standard 

15 video function buttons: play/stop button 503, step backward button 507, step forward button 
509, a random seek slider 5 1 1, and an on/off hot-link highlight button 505. The play/stop button 
503 provides the user with the papability to eontrol the HOTVIDEO PRE VIEWER to play the 
video file (i.e., step through the frames of the video file and output the frame image data for dis- 
play) and stop playing the video file (i.e., terminate stepping through the frames of the video file 

20 and output for display the frame image data for the frame corresponding to the stop request). The 
step forward and step backward buttons 507,509 provide the user with the capability to control 
the HOTVIDEO PREVEBWER to decode and output for display the next frame/previous frame 
from the current frame. The seek slider 51 1 provides the user with the capability to control the 
HOTVIDEO PRE VIEWER to decode and output for display a particular video frame, which may 

25 be identified by the position of a slider on a slider bar. Finally, the an on/off hot-link highlight but- 
ton 505 provides the user with the capability of controlling the HOTVIDEO PRE VIEWER to 
toggle on/off the display of hot-link regions in the video window 501. 
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On the right is the Object Window (OW) 521 with the name and location 523 of the video file 
which the author is encoding, the URL 524 that identifies to the HOTVIDEO PLAYER which 
will eventually access the Hot Video data file where to look for the associated video file, a list of 
objects 525 which will be defined together with their hot-link region KEY frames and coordinates, 
5 and a list of URL links 527 associated with the defined objects. 

When the software application is started, preferably the tool window 531 is displayed. If the 
author is beginning from scratch, New is selected from the File menu. The Object Window will 
then appear. The Open button in the OW is then used to load the video file which will be encoded 
with hot-link information. The VW will then appear with the first frame of the video in the video 
10 region. If the author wishes to open an existing Hot Video data file and continue working on it, 
the Open button is selected from the File menu. Again the OW will appear, this time with all the 
already created information. Again, the Open button in the OW is used to load the video file 
which will be encoded with hot-link information. 

To encode the first (or next) object, the author navigates through the frames of video stops at a 
15 frame where the author wishes to encode the frame with hot-link information. The author can 
navigate through the frames by pressing the play button 503, by using the random seek slider 51 1, 
or by entering the frame number in the appropriate box in VW 513. In addition, the author can 
use the step forward and step backward buttons 507,509 to identify the starting KEY frame for a 
hot object. Once the initial KEY frame is identifies, the author defines the hot-link region, for ex- 
20 ample by defining a rectangular region around the object. This may be accomplished utilizing con- 
ventional techniques: point the cursor at the top-left corner of the desired rectangle, drag it to the 
bottom-right comer, and release it. A dotted-line rectangle will appear as drawn, with corners 
highlighted. At the bottom of the VW, preferably the information regarding the hot-link region - 
its coordinates and the URL it is pointing to- is displayed. Moreover, the geometry of the hot-link 
25 region preferably can be edited, for example by clicking the left button of the mouse when the cur- 
sor is inside the rectangle and then dragging the mouse or by clicking the left button of the mouse 
when the cursor is on top of any of the four highlighted corners and then dragging. In addition, 
the author preferably can undo the definition of the hot-link region, for example, by clicking the 
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right mouse button with the cursor inside the rectangle, a menu will appear, and then clicking cut 
or delete from the menu. 



Once the hot-link region has been defined, the author associates the defined region to an object. 
For example, the author may associate the defined region with an object by clicking the right 
5 mouse button when the cursor is inside the hot-link region. A menu then pops up that includes an 
"Add to" button. Click on the "Add to" and a subordinate menu will prop up. This new menu will 
have a list of all the already defined objects plus a "New Object." If this region will be associated 
with an existing object, identify the existing object by clicking on the existing object with the left 
mouse button; otherwise enter the name of the "New Object." 

10 If the hot-link region is associated with an existing object, the software application will automati- 
cally enter the new information in the appropriate place in the OW. For a New Object, a New Ob- 
ject Window will pop up and prompt you for information: the object name and the link command 
associated with the object, for example, a URL associated with the object. Also in this window 
will be a list of already used link commands; in the case that you want to specify an already used 

15 link command, simply click on it with the left button. Preferably, after a hot-link region has been 
associated with an object, the display attributes of the hot-link region are altered to notify the 
author, for example, by changing the border of the hot-link region from dotted lines to solid lines. 

With the first KEY frame encoded, the author can then encode the next Key frame using the same 
steps described above. Preferably, as the author navigates through the frames of video, the HOT- 

20 VIDEO PREVIEWER displays the last defined hot-link region. When the author wishes to en- 
code the next KEY frame, the author can use either the last defined hot-link region, or draw 
define a new hot-link region. To use the last defined hot-link region, the author simply uses the 
last defined region as if the author had just drawn it. Should the author define a new region, pref- 
erably the last defined region still appears on the screen; this provides the author with the ability to 

25 compare the relative positions of the two regions. 

After the author has encoded the hot object-in the last KEY frame of a particular time interval, the 
author identifies that frame as an END frame. Preferably, this is accomplished by moving the 
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mouse into the Object Box inside the OW and clicking the left mouse button on the frame label 
thereby highlighting the frame. Then click on the right mouse button to pop up a menu box that 
includes a "Mark as End Frame" selection. Select "Mark as End Frame". As shown in FIG. 7, 
the KEY-frame arrow 570 will change form and become an END-frame arrow 571 thereby alert- 
5 ing the author that the change has taken place. Preferably, the author can change an END-frame 
to a KEY-frame (which means, not an END-frame) by moving the mouse into the Object box in 
the OW and clicking on the left mouse button over the frame label 573, and then clicking on the 
right mouse button to pop up a menu that includes a "Mark as Key Frame" selection. Select 
"Mark as Key Frame". The END-frame arrow 571 will change form and become a KEY-frame 
10 arrow 570 thereby alerting the author that the change has taken place. Preferably, any Key or 
End frame may be deleted by moving the mouse into the Object box in the OW and clicking on the 
left mouse button over the frame label 573, and then clicking on the right mouse button to pop up 
a menu that includes a "Delete" selection. Select "Delete". 

Preferably, a single or double click on any frame label 573 in the Objects box of OW will cause the 
15 video in VW to jump to that frame. Moreover, double clicking on any object label 575 in the Ob- 
jects box in OW causes the associated key frames information to collapse if they arc presently visi- 
ble and conversely expand if they are presently collapsed. Preferably, this may also be achieved by 
clicking the right button with the cursor on the object label 575 to pop up a menu that includes an 
appropriate command. 

20 Preferably, the author can preview the integration of the hot-link information into the video file 
using the HOTVIDEO PRE VIEWER, for example, by clicking on the play button and using the 
on-off button 505 to preview with or without the hot-link regions highlighted. 

The HOTVIDEO authoring tool is advantageous because the author need not define the hot-link 
region in each frame wherein the hot-link region exists. The author defines hot-link regions in key 
25 frames; as described above the HOTVIDEO PLAYER utilizes interpolation to position the hot- 
link region in those frames which are between two key frames. This reduces the size of the Hot- 
Video file; instead of having encoded data for each frame, one has data for key frames only. Sec- 
ond, the Hot Video file is much easier to encode; the encoding process is speeded up because one 



WO 98/44435 



PCT/IB97/00331 



-20- 

only has to encode key frames. For example, if on average there are 40 frames between key 
frames, then the size of the hot info data file is approximately l/40th than what it would have been 
had every frame been encoded, and also the encoding process would be approximately 40 times 
faster. 

5 

In addition, the present invention preferably stores the HotVideo data and corresponding video 
file in separate and distinct files. This provides enormous flexibility to users. For example, one 
may transmit HotVideo data to a user who already has a local copy of a video (e.g., one has a 
copy of video on a CD and obtains the HotVideo data from a Web site). However, the present in- 
10 vention is not limited in this respect; in the alternative, the HotVideo data of the present invention 
and associated video data may be stored in a common file. 

It should be apparent to those skilled in the art that the methods and functionality of the present 
invention as described above can be embodied in a program storage device readable by a machine, 
that tangibly embodies the methods and functionality of the present invention as described above 
15 and is used by the machine in the execution of a program of instructions. While the invention as 
been described in terms of preferred embodiments, those skilled in the art will recognize that the 
invention can be practiced with modification within the spirit and scope of the appended claims. 
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Claims 

1 . A method for representing hyperlinks in frames of video stored in a first file, the method 
comprising the step of: 

5 storing in a second file, different from said first file, information defining at least one hot 

region in said frames of video stored in said first file. 

2. The method of claim 1, wherein said video is encoded in a standard format. 

3. The method of claim 2, wherein said standard format is one of AVI f MPEG, raw YUV, 
and raw RGB. 

10 

4. The method of claim I , wherein said information defines a boundary of said at least one 
hot region in a plurality of frames of said video. 

5. The method of claim 4, wherein said at least one hot region is a polygon comprising a plu- 
rality of vertices, and wherein said boundary of said at least one hot region is defined by position 

1 5 of vertices of said polygon. 

6. The method of claim 5, wherein said polygon is a rectangle having a top left vertex, a top 
right vertex, a bottom left vertex and a bottom right vertex, and wherein said boundary of said 
rectangle is defined by position of said top left vertex and said bottom right vertex. 

7. Thejnethod of claim 4, wherein said at least one hot region is a circle having a center and 
20 a radius, and said boundary of said hot region is defined by position of said center and said radius. 

8. The method of claim 1 , wherein said information defines said at least one hot region in key 
frames of said video stored in said first file, wherein one key frame is a start frame and one key 
frame is an end frame, and wherein said hot region is not defined in at least one frame between 
said start frame and said end frame. 
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9. The method of claim 8, wherein said key frames include at least one intermediate key 
frame between said start frame and said end frame, wherein said hot region is not defined in at 
least one frame between said start frame and said at least one intermediate key frame, and wherein 
said hot region is not defined in frames between said at least one intermediate key frame said end 

5 frame. 

10. The method of claim 9, wherein said key frames include first and second 
intermediate key frames between said start frame and said end frame, and wherein said hot region 
is not defined in at least one frame between said first intermediate key frame and said second 
intermediate key frame. 

10 11. The method of claim 8, further comprising the steps of: 

identifying said key frames based upon user input; and 

generating said information defining at least one hot region based upon user 
inpuL 

1 2. The method of claim 1 , further comprising the steps of: 

15 associating said hot region with at least link command based upon user in- 

put; and 

representing association between said hot region and said at least one link 
command in said second file. 

13. The method of claim 12, wherein association between said hot region and said at least one 
20 link command is represented by organization of data stored in said second file. 
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14. The method of claim 1 3, wherein said data stored in said second file includes an entry 
identifying said hot region and corresponding link command. 

15. The method of claim 1 f further comprising the steps of: 

5 assigning an object identifier to an object corresponding to said hot region; 

associating said hot region with said object identifier based upon user input; 

representing association between said hot region and said object identifier 
in said second file. 

16. The method of claim 15, wherein association between said hot region and said object iden- 
10 tifier is represented by organization of data stored in said second file. 

17. The method of claim 1 6, wherein said data stored in said second file includes an entry 
identifying said hot region and corresponding object identifier. 

1 8 . The method of claim 1 5, further comprising the steps of: 

associating at least link command with said object identifier based upon 
1 5 user in P u *. thereby associating said at least one link command with said hot 

region; and 

representing association between said link command and said object identi- 
fier in said second file. 

19. The method of claim 18, wherein association between said link command and said object 
20 identifier is represented by organization of data stored in said second file. 



WO 98/44435 



PCT/IB97/00331 



-24- 

20. The method of claim 19, wherein said data stored in said second file includes an entry 
identifying said pbject identifier, corresponding link command, and corresponding hot region. 

21. A method for representing hyperlinks in frames of video, the method comprising the step 
of: 

5 storing information defining at least one hot region in key frames of said video, wherein 

one key frame is a start frame and one key frame is an end frame, and wherein said hot region is 
not defined in at least one frame between said start frame and said end frame. 

22. The method of claim 2 1 , wherein said key frames include at least one 

intermediate key frame between said start frame and said end frame, wherein said hot region is not 
10 defined in at least one frame between said start frame and said at least one intermediate key frame, 
and wherein said hot region is not defined in frames between said at least one intermediate key 
frame said end frame. 

23. The method of claim 22, wherein said key frames include first and second 
intermediate key frames between said start frame and said end frame, and wherein said hot region 

15 is not defined in at least one frame between said first intermediate key frame and said second 
intermediate key frame. 

24. The method of claim 2 1 , further comprising the steps of: 

identifying said key frames based upon user input; and 

generating said information defining at least one hot region based upon user 
20 input. 

25. The method of claim 21 , wherein said video is encoded in a standard format. 
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26. The method of claim 25, wherein said standard format is one of AVI, MPEG, raw YUV, 
and raw RGB. 

27. The method of claim 21, wherein said information defines a boundary of said at least one 
5 hot region in a plurality of key frames of said video. 

28. The method of claim 27, wherein said at least one hot region is a polygon comprising a 
plurality of vertices, and wherein said boundary of said at least one hot region is defined by posi- 
tion of vertices of said polygon. 

29. The method of claim 28, wherein said polygon is a rectangle having a top left vertex, a top 
10 right vertex, a bottom left vertex and a bottom right vertex, and wherein said boundary of said 

rectangle is defined by position of said top left vertex and said bottom right vertex. 

30. The method of claim 27, wherein said at least one hot region is a circle having a center and 
a radius, and said boundary of said hot region is defined by position of said center and said radius. 

3 1 . The method of claim 2 1 , further comprising the steps of: 

1 5 associating said hot region with at least link command based upon user in- 

put; and 

representing association between said hot region and said at least one link 
command in said information. 

32. The method of claim 3 1 , wherein association between said hot region and said at least one 
20 link command is represented by organization of said information. 

33. The method of claim 32, wherein said information comprises an entry identifying said hot 
region and corresponding link command. 
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34. The method of claim 2 1 , further comprising the steps of: 

assigning an object identifier to an object corresponding to said hot region; 

associating said hot region with said object identifier based upon user input; 

representing association between said hot region and said object identifier 
5 in said information. 

35. The method of claim 34, wherein association between said hot region and said object iden- 
tifier is represented by organization of said information. 

36. The method of claim 35, wherein said information comprises an entry identifying said hot 
region and corresponding object identifier. 

10 37. The method of claim 34, further comprising the steps of: 

associating at least link command with said object identifier based upon 
user input, thereby associating said at least one link command with said hot 
region; and 



representing association between said link command and said object identi- 
1 5 fier in said information. 

38. Thejnethod of claim 37, wherein association between said link command and said object 
identifier is represented by organization of said information. 

39. The method of claim 38, wherein said information comprises an entry identifying said ob- 
ject identifier, corresponding link command, and corresponding hot region. 
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40. The method of claim 21, wherein said video is stored in a first file and said information is 
stored in a second file, different from said first file. 

41. The method of claim 21, wherein said video and information are stored in a common file. 

42. A method for integrating hyperlinks with frames of video comprising the steps of: 

5 providing a first file storing frames of video; 

providing a second file, different from said first file, storing information defining at least 
one hot region in said frames of video; 

selecting at least one frame of video for display; 

upon determining that said second file includes information that defines a hot region in the 
10 selected frame, 

identifying a plurality of pixels of the selected frame that correspond to said hot region, 
and 

modifying color value of the identified pixels to thereby identify said hot region in said 
frame. 

1 5 43. The method of claim 42, wherein said video is encoded in a standard format. 

44. The method of claim 43, wherein said standard format is one of AVI, MPEG, raw YUV, 
and raw RGB. 

45. The method of claim 42, 
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wherein said information defines a boundary of said at least one hot link region in a plural- 
ity of frames of video; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
5 of said boundary of said at least one hot region in the selected frame. 

46. The method of claim 45, 

wherein said at least one hot region is a polygon comprising a plurality of vertices, and 
wherein said boundary of said at least one hot region is defined by position of vertices of said 
polygon; and 

10 wherein the step of identifying a plurality of pixels of the selected frame that correspond to 

said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
of lines that connect said vertices. 

47. The method of claim 46, 

15 wherein said polygon is a rectangle having a top left vertex, a top right vertex, a bottom 

left vertex and a bottom right vertex, and wherein said boundary of said rectangle is defined by 
position of said top left vertex and said bottom right vertex; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
20 of said boundary of said rectangle. 

48. The method of claim 45, 

wherein said at least one hot region is a circle having a center and a radius, and said 
boundary of said hot region is defined by position of said center and said radius; and 
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whereinthe step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
of said boundary of said circle. 

5 49. The method of claim 42, wherein said information defines said at least one hot region in 
key frames of said video stored in said first file, wherein one key frame is a start frame and one 
key frame is an end frame, and wherein said hot region is not defined in at least one frame between 
said start frame and said end frame. 

50. The method of claim 49, wherein said key frames include at least one 

10 intermediate key frame between said start frame and said end frame, wherein said hot region is not 
defined in at least one frame between said start frame and said at least one intermediate key frame, 
and wherein said hot region is not defined in frames between said at least one intermediate key 
frame said end frame. 

5 1 . The method of claim 50, wherein said key frames include first and second 

15 intermediate key frames between said start frame and said end frame, and wherein said hot region 
is not defined in at least one frame between said first intermediate key frame and said second 
intermediate key frame. 

52. The method of claim 49, 

wherein the step of determining whether said second file includes information that defines 
20 a hot regional the selected frame includes the step of determining whether the selected frame lies 
between key frames; and 



wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the steps of: 
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interpolating position of said hot region in said selected frame based upon 
position of said hot region in said key frames, and 

identifying pixels corresponding to said hot region is said selected frame 
based upon the interpolated position of said hot region in said selected 
5 frame. 

53. The method of claim 42, further comprising the steps of : 

storing a link command associated with said at least one hot region; and 

executing said link command upon user selection of said at least one hot region. 

10 54. A method for integrating hyperlinks with frames of video comprising the steps of: 

providing frames of video; 

providing information defining at least one hot region in key frames of said video, 
wherein one key frame is a start frame and one key frame, is an end frame, and wherein said hot re- 
gion is not defined in at least one frame between said start frame and said end frame; 

1 5 selecting at least one frame of video for display; 

upon determining that said information defines a hot region in the selected frame, 

identifying a plurality of pixels of the selected frame that correspond to said 
hot region, and 



20 



modifying color value of the identified pixels to thereby identify said hot re- 
gion in said frame. 
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55. The method of claim 54, wherein said key frames include at least one 

intermediate key frame between said start frame and said end frame, wherein said hot region is not 
defined in at least one frame between said start frame and said at least one intermediate key frame, 
and wherein said hot region is not defined in frames between said at least one intermediate key 
5 frame said end frame. 

56. The method of claim 55, wherein said key frames include first and second 
intermediate key frames between said start frame and said end frame, and wherein said hot region 
is not defined in at least one frame between said first intermediate key frame and said second 
intermediate key frame. 

10 57. The method of claim 54, 

wherein the step of determining whether said second file includes information that defines 
a hot region in the selected frame includes the step of determining whether the selected frame lies 
between key frames; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
15 said hot region includes the steps of: 

interpolating position of said hot region in said selected frame based upon 
position of said hot region in said key frames, and 

identifying pixels corresponding to said hot region is said selected frame 
^ ^ based upon the interpolated position of said hot region in said selected 
20 frame. 

58. The method of claim 54, wherein said video is encoded in a standard format. 

59. The method of claim 58, wherein said standard format is one of AVI, MPEG, raw YUV, 
and raw RGB. 
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60. The method of claim 54, 

wherein said information defines a boundary of said at least one hot link region in a plural- 
ity of key frames of video; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
5 said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
of said boundary of said at least one hot region in the selected frame. 

6 1 . The method of claim 60, 

wherein said at least one hot region is a polygon comprising a plurality of vertices, and 
wherein said boundary of said at least one hot region is defined by position of vertices of said 
10 polygon; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
of lines that connect said vertices. 

1 5 62. The method of claim 6 1 , 

wherein said polygon is a rectangle having a top left vertex, a top right vertex, a bottom 
left vertex and a bottom right vertex, and wherein said boundary of said rectangle is defined by 
position ofjaid top left vertex and said bottom right vertex; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
20 said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
of said boundary of said rectangle. 

63. The method of claim 60, 
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whereinsaid at least one hot region is a circle having a center and a radius, and said 
boundary of said hot region is defined by position of said center and said radius; and 

wherein the step of identifying a plurality of pixels of the selected frame that correspond to 
said hot region includes the step of determining pixels of the selected frame that lie in the vicinity 
5 of said boundary of said circle. 

64. The method of claim 54, further comprising the steps of : 

storing a link command associated with said at least one hot region; and 
10 executing said link command upon user selection of said at least one hot region. 

65. The method of claim 54, wherein said video is stored in a first file and said information is 
stored in a second file different from said first file. 

66. The method of claim 54, wherein said video and information are stored in a common file. 
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